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Motivation 


The aspect of "one size fits all" surrounding the conventional 
design of clinical trials has been challenged, particularly 

• when the disease is considered heterogeneous 

• or the experimental therapy is tailored to a specific mechanism of action 


W 


One size fits all W Tailoring ^ Targeted Therapy 


create diagnostic, prognostic and 
therapeutic strategies taiiored for 
specific groups of patients 
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Patients Can Respond Differently 



The Case for Personalized Medicine Journal of Diabetes Science and Technology 

Edward Abrahams, Ph.D.,^ and Mike Silver, Ph.D.^ Volume 3, IsSUe 4, July 2009 
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New Opportunities 


The development of biomarkers that define specific 
subsets of disease is enabling a shift from empirical 
medicine to precision (stratified) medicine 
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A Paradigm Shift 




Drug tOKiC but 
beneficidl 


Patient group 





Drug toxic but 
NOT beneficial 


Drug NOT toxic and 
NOT beneficial 


Same diagnosis, 
same prescription 



Drug NOT toxic 
and beneficial 


http ://www.jyi.org/teatures/tt.phpVicl=1047 




Personalized 

Medicine 

• Delivering the right 
medicine, 

• to the right patient, 

• at the right dose, 

• at the right time 


Empirical Medicine 

• Blockbuster drugs targeted at 
broad population segments 

• On average, 50% of patients do 
not have desired therapeutic 
outcomes 

• Significant adverse events 


Precision 

Medicine 

• Drugs targeted at subgroups 
of patient population 

• Genomic profiles determine 
segmentation and therapy 

• Best possible therapeutic 
outcome with minimal 
adverse events 


“Personalized Medicine means knowing what works, knowing why 
it works, knowing who it works for and applying the knowledge for 
patients” M\chae\ Leavitt, Secretary of Health and Human Services 
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Potential Benefits 


• Patients receive more effective drugs with fewer side 
effects giving better outcomes 


• Avoid time and resources wasted trying unsuitable 
medicines 


• Accelerating the development and availability of new 
diagnostics, medicines and treatment pathways 
benefit patients, healthcare providers and business. 
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FDA Draft Guidance for Industry: 
Enrichment Strategies for Clinical Trials 


Guidance for Industry 


Enrichment Strategies for Clinical Trials to 
Support Approval of Human Drugs and 
Biological Products 


DRAFT GUIDANCE 


U*S. Department of Health autl Human Services 
Food and Drug Administration 
Center for Drug Evaluation and Research (CDER) 
Center for Biologies Evaluation and Research (CBER) 
Center for Devices and Radiological Health (CDRH) 

December 2012 
Clinical Medical 
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Definition 


Enrichment 


• is prospective use of any patient 
characteristic 

• demographic, pathophysiologic, historical, genetic, and 
others 

• to select a study population in which 

• detection of a drug effect (if one is in fact 
present) is more likely than it would be in 
an unselected population 
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Reasons for enrichment 


The main reason for enrichment is 
study efficiency 


• increasing the chance of success, often 
with a smaller sample size 

• providing major benefits of individualization, 

• directing treatment where it will do the most 
good 

• sparing potential harm to people who 
cannot respond 
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Key Concepts 


• Extension from the conventional single population 
design objective to an objective that encompasses 
several possible patient sub-populations 

• Allow more informative evaluation in the patients having 
different degrees of responsiveness to the therapy 

• At an interim stage, it is decided which subpopulation is 
selected for further inference (including all 
subpopulations, i.e., full population) 

• Not only selection procedures, but also other adaptive 
strategies (e.g., sample size reassessment, stopping rule) 
can be performed 
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EXAMPLE 1 
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I-SPY Model: A new paradigm in drug 
development 


• Mainly focused on exploratory stage of DD 

- Match drugs with biomarker signatures 

- Savings from using a common control 

- Better therapies move through faster 

- Successful drug/biomarker pairs graduate to 

• small, 

• focused, 

• more successful Phase 3 

- based on Bayesian predictive probabilities 

• Opens new opportunities in confirmatory stage of DD 
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THE WALL STREET JOURNAL. 

WSJ.Gom 


THE SATURDAY ESSAY | OCTOBER 2, 2010 

A New Rx for Medicine 

Fed up with slow drug trials, cancer patients and doctors are testing a fast track to personalized 
treatments. 


By RON WINSLOW 


PERSONALIZED MEDICINE | How redesigning a ciinicai triai can speed drug deveiopment 

PHASE III 

If a drug graduates to phase III, it 
typically takes 3,000 patients 
and about three years to 
determine if it is safe and 
effective enough for approval. 



HISTORIC SUCCESS RATE 

30to400/o 


PHASE III 

Researchers expect that drugs 
graduating from l-Spy 2 to phase III 
can be tested with 300 patients 
selected according to genetic profiles 
found to respond to the drug in phase 
II. It is hoped that thiswill shorten the 
time to approval. 

PROBABILTY OF SUCCESS 

850/0 


Source: Donald Berry, M.D. Anderson Cancer Ce|i|g^ 



^ 1 cube = 10 patients 

Traditional 
clinical trial 

Takes essentially all 
patients with a disease 
being studied and is 
typically intended to 
eliminate differences in 
patient characteristics 
that could bias measures 
of drug effectiveness. 


Note: In all clinical trials, phase I 
consists of testing on human subjects 
to determine toxicity levels. 

Graphic by Maryanne Murray/WSJ 


Patients are placed in groups 
based on genetic profiles and are 
randomly assigned to either 
standard therapy or one of 
five different drugs plus 
standard care. 


PHASE II 


Randomized or non-randomized trial: In a randomized trial, 
about 60 patients are put in two groups: One receives the experimental 
drug and the other serves as a control group. In a non-randomized trial, 
about 40 patients receive the experimental drug. 


New trial design 

Uses genetic profiles to 
highlight 'biomarker' 
differences among 
patients and to match 
drugs to patients with 
biomarkers that predict 
a benefit. 

PHASE II 


More successful 
drugs move on 
to phase III. 


ui uyDdic 

eliminated. 


Early results increase chances that 
patients entering the trial later 
will be assigned to a drug 
showing benefit against tumors 
with their genetic profile. 


It will take up to 120 patients 
for each drug to determine 
which ones graduate to 
phase III studies. 




















Phase 3 Study in HER2- 


• Assume that one of the experimental drugs 
has been graduated from the l-SPY 2 trial 
with the biomarker signature of triple 
negative breast cancer (TNBC) but also with 
some promising effect in HER2- biomarker 
signature. 

• Option 1 : a confirmatory Phase 3 trial in 
TNBC patients only 

- prevalence of TNBC is only 34% 

• Option 2: a confirmatory Phase 3 trial in 
HER2- patients 

- prevalence of HER2- is 63% 

• Option 3: Adaptive enrichment design 

- run a confirmatory trial with a two-stage enrichment 
design 

- starting with the full population (HER2- patients), 

- but with the preplanned option of selecting only the 
TNBC patients after the 1 st stage in case the 
observed effect is not promising in the HER2- patients 
with positive hormone-receptor status HR-i- 
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MBC Patients 


Biomarker 

Profile 

Patient Type (HR, HER2, MP) 

Est. 
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HER2+ 


f 


f 



1 

f 


f 



37% 

HER2- 
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f 

63% 

MP+ 
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48% 

TNBC 
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f 

34% 

HR-/HER2+ 
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17% 

HR+/HER2+ 
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20% 

HR+/HER2- 



± 
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29% 


Acknowledgment. D. Berry. l-SPY-1 Results 
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Adaptive Population Enrichment Design 



■ Stagel objective 

• Stop for futility/efficacy 

• To continue with HER2- (Full) population 

• To confirm greater benefit in TNBC Subpopulation (Sub) 

• To adjust the sample size 

■ Stage 2 data and the relevant groups from Stage 1 data combined 
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Ballpark Sample Size Calculations 


Primary Endpoint: 
pathologic complete 
response (pCR) at 
surgery 

Power: 90% 

Sign. Level: 0.025 
Control Rate: pCR=0.3 
TRT Effect: 0.2 



Plan 1 
Rates 

Plan 2 
Rates 

Plans 

Rates 

alpha 

0.0125 

0.0125 

0.0125 

Futility stops 

- 

- 

- 

tails 

1 

1 

1 

K 

1 

1 

1 

Design 

- 

- 

- 

Information rates 

- 

- 

- 

Hypothesis 

diff<=0 

diff<=0 

diff<=0 

Parameters 

pi1=0.3 

pi2=0.4 

pi1=0.3 

pi2=0.45 

pi1=0.3 

pi2=0.5 

Power ^ 

30.0 

30.0 

30.0 

Total A5N HO 

- 

- 

- 

Total ASH HOI 

- 

- 

- 

Total ASM HI 

- 

- 

- 

Total maKimum N 

1124.3 

512.G 

233.3 

Allocation 

1 

1 

1 






Possible TRT Effect Range: 
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Plan 4 
Rates 

0.0125 

1 

1 


diff<=0 

pi1=0.3 

pi2=0.55 

30.0 


183.5 

1 


[0.1 - 0.25] 
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Population Enrichment Simulation 


Patient Profile 

MP- 

MP- 

MP- 

MP- 

MP+ 

MP+ 

MP+ 

MP+ 


Her2+ 

Her2+ 

Her2- 

Her2- 

Her2+ 

Her2+ 

Her2- 

Her2- 



HR+ 

HR- 

HR+ 

HR- 

HR+ 

HR- 

HR+ 

HR- 

F 


f 

f 

f 


f 

f 

f 

f 

) 

Prevalence 

16% 

7% 

23% 

6% 

4% 

10% 

6% 

28% 


Predicted pCR 

47% 

67% 

25% 

43% 

35% 

55% 

17% 

32% 



Acknowledgment D. Berry. l-SPY-1 Results 
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• Prevalence of TNBC in HER2-: 54% 

• Control pCR Rate in TNBC: 0.34 

• Control pCR Rate in HER2- fl HR+: 0.23 

• Total of 21 Simulation Scenarios: 

■ TRT effect in TNBC: 0 to 0.3 by 0.05 

■ TRT effect in HER2- fl HR+: 0, 0.1,0.2 


Design 

• Total sample size: 300 patients 

• Stage 1 sample size:150 pats 

• Testing strategy: inverse 
normal p-value combination 

• Intersection test: Bonferroni 

• Selection rule: e= 0.1 rule 


























Operating Characteristics: 


Leyeiifl 

[7 — Power 

|7 - P_Reject F 

|7 - P_Reject SI 
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Power I P_Reject F | P_Reject SI vs. Effect SI 

piT Subset2 = 0.230 
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Operating Characteristics: 


Leyeiifl 

[7 — Power 

|7 - P_Reject F 

|7 - P_Reject SI 
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Power I P_Reject F | P_Reject SI vs. Effect SI 


piT Subset2 = 0.330 



0 H-1-1-1-1-1-1-1-1-1-1-1-1-1-1- 

0 0.02 0.04 0.06 0.08 0.1 0.12 0.14 0.16 0.18 0.2 0.22 0.24 0.26 0.28 0.3 


Effect SI 
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Operating Characteristics: 


Leyeiifl 

[7 — Power 

|7 - P_Reject F 

|7 - P_Reject SI 
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Power I P_Reject F | P_Reject SI vs. Effect SI 


piT Subset2 = 0.430 



0 H-1-1-1-1-1-1-1-1-1-1-1-1-1-1- 

0 0.02 0.04 0.06 0.08 0.1 0.12 0.14 0.16 0.18 0.2 0.22 0.24 0.26 0.28 0.3 


Effect SI 
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Sample Size Reestimation 


• Allow up to a 3-fold sample size increase for Stage 2 

• 90% Conditional Power based on observed TRT effect 

• Total Sample Size: 300 - 600 
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Operating Characteristics 


Legend 

[7 — Power 

|7 - P_Reject F 

|7 - P_Reject SI 
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Power I P_Reject F | P_Reject SI vs. Effect SI 


piT Subset2 = 0.430 



0 0.02 0.04 0,06 0,03 0,1 0,12 0,14 0,16 0.18 0.2 0,22 0,24 0,26 0,23 0,3 


Effect SI 
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Operating Characteristics 


y-Axis 

p' - Power 

p - P_Reject F 

p - P_Reject SI 

p - Total ASN 
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Power I P_Reject F | P_Reject SI | Tot... vs. Effect SI 


piT Subset2 = 0.430 



0 0.02 0,04 0,06 0.08 0,1 0,12 0,14 0,16 0,18 0,2 0.22 0,24 0,26 0.28 0,3 


Effect SI 
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Total ASN 

















































































METHODOLOGY 
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Adaptive Confirmatory Designs 


All information available in an interim analysis may be used for 
planning the subsequent stages of the trial, under control of the 
prespecified Type I error rate. 

Two pioneering proposals: 

1. Bauer & Kohne (Biometrics, 1994): 

Combination of p-values with a specific combination function 
(Bauer, 1989) 

2. Proschan & Hunsberger (Biometrics, 1995): 

Specification of a conditional error function 
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Procedure of Bauer & Kohne (1994) 


Stage 1: 

Pi 

1_1_1_1 

0 

ttl 

tto 

1 







rejection of 



acceptance 
of Ho 


Stage 2: 

I 



1 


0 


1 


rejection of 



acceptance 
of Ho 
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Procedure of Bauer & Kohne (1994) 


• Use of Fisher's combination test to combine the separate stage 
p-values Pi and P2, i.e., C(p^,P2) = P1P2 

• Under Hq, the p-values are stochastically independent, 
irrespective of the choice of the design for the second stage. 

• Hq is rejected after the second stage if 

p^P2<c„ = exp{-^/2zla) 

• Other combination functions C(p^,P2) and/or more than two 
stages can also be considered. 

• In the two stages, different hypotheses can be considered, the 

1 0 

considered global test is a test for Hq = Hq n Ho 
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Adaptive Design using the inverse normal method 


Consider at Mh stage, k= A,2,...,K: 

T -r(n n + + + 

‘k - '-'\P^^"■^Pk) - ^ 

N(0^,^) if P;( uniformly distributed on [0; 1] 


Under Hq, the same distributional assumption as for the group 
sequential tests applies and, therefore, the decision regions of the 
traditional group sequential tests can be used. 

Lehmacher & Wassmer, 1999 
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Properties 


• Decision regions of group sequential tests can be used 

• Generalization to more than two stages and more general designs 
straightforward 

• Use unweighted mean of test statistics from the separate stages 
also for unequal and arbitrarily (data dependent) fixed sample sizes. 

• Effect on power Is small unless „dramatlc“ changes In sample size 
were performed 

• Can also be used In testing situations with nuisance parameters 

• If no design changes were performed, the inverse normal 
technique yields the traditional test 
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Methodology for Population Enrichment 


• Sources for alpha inflation 

- Interim analyses 

- Sample size reassessment 

- Selection from multiple sub-populations 

• The adaptive procedure strongly controls the 
pre-specified family-wise Type I error rate 

• The procedure is based on the application of the 
closed test procedure together with combination 
tests 
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The Enrichment Test Procedure 


• Consider prespecified subpopulation(s) Si,...,Sq , which 
can be nested, and a full population F: 

Sq c...cSi c F 

• The proposed adaptive procedure fulfills the regulatory 
requirements for the analysis of adaptive trials in that it 
strongly controls the prespecified (familywise) Type I 
error rate 
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Closed testing procedure 


stage 1 



stage II 


n n 

1 


9 

■ 

1 


n 

^ 1 

9 

■ 


h!' 

Y 

h! 


Simple “trick”: Test of intersection hypotheses are formally 

performed as tests for Hq. 

Hq can be rejected if all combination tests exceed the critical value Uj- 
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Closed testing procedure: Stage II 


Example S= S 2 

Stage I Stage II 



> Ho'can be rejected if all combination tests exceed the critical value U2. 

> The choice of tests for intersection hypotheses is free. You might use 
Bonferroni, Simes or Sidak tests. 

> For one subgroup also Dunnett's test can be applied 
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Test strategies 


• Combination test: 

- Inverse normal method 

- Fisher's combination test 

• Separate Phase ll/lll: 

- Phase II only for sub-population selection 

- Phase III is group sequential 

• Intersection Tests: 

- Dunnett 

- Bonferroni 

- Sidak 

- Simes 

- Hierarchical 
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Selection Procedure 


• Select the (sub)population with the largest effect 

• Select r sets with largest effect 

• Select sets with effect compared to full population 
not worse than £ 

• Select /-th set 

• Select a set if effect exceeds a threshold t 

• Drop a set if CP <x 

• Effect measured on test statistic or mean effect scale 
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Different Configurations 
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EXAMPLE 2 
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Simulation Study: Continuous Endpoint 


• Two-Stage design with no early stopping, one sub-population 

• In the biomarker positive population a standardized effect of 0.5 is assumed, 
biomarker negative population has effect sizes ranging from 0 to 0.5 

• Selection rules: 

1. Select the population with highest effect size 

2. Select the population with effect size compared to the better not worse than 0.25 

3. No selection 

• Prevalences of biomarker positive population is 5%, 10%, 20%. 

• Sample size: 100 patients per stage 

• Simes‘ test is used for testing intersection hypotheses. 
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ADDPLAN™: Adaptive Designs - Plans and Analyses 


ADDPLAN Base is a comprehensive package for the planning, 
simulation and analysis of clinical trials, comprising 

- traditional fixed sample designs 

- group sequential designs: O'Brien & Fleming, Pocock, Wang & Tsiatis, 
Pampallona & Tsiatis 

- a- and yS-spending function approaches: Kim & DeMets, Pocock, 
O'Brien & Fleming, Hwang, Shih & DeCani, user defined a-spending 
and /^-spending 

- Flexible (adaptive group sequential) designs: 

• inverse normal designs; Lehmacher & Wassmer, Cui, Hung & 
Wang, 

• p-value combination designs; Bauer&Koehne 

• conditional error function designs; Proschan&Hunsberger, 
Muller&Schafer 
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ADDPLAN 6.0 





1 

ADDPLAN 6.0 Adaptive Designs Plans and Analyses 

1 Simiilate Design 

- n X 

i 

^ New Plan 

Adaptive Ana lysis I Options | Mein 




irn Test of means... 
Test of rates... 


Noninferiority of means... 
Noninferiority of rates... 


Survival analysis... ' Noninferiority survival... 


I \l\ Test of means multi arm 
[W] Test of rates multi arm 
IS Survival analysis multi arm 


Simulate Design 




Enrichment design means 
Enrichment design rates 
Enrichment design survival 



ADDPLAN 6.0 Adaptive Designs Plans and Analyses | Adaptive Analysis 


- n X 
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Specifications: Procedures 
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Specifications: Stopping Rule 
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Specifications: Selection Rule 
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Specifications: Sample Size Reestimation 
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Specifications: Scenarios for Simulation 
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Power 


Power plot 


Power vs. Effect subset 2 

Prevalences = (20 80) 

IH 



0 H- 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 -r 

0 0.05 0.1 0.15 0.2 0.25 0.3 0.35 0.4 0.45 0.5 

Effect subset 2 


Selection rule 

17 - - Select set with largest effect at stage 1 (difference) 

17 - - Select the 2 sets with largest effect at stage 1 (difference) 

p' - Select sets with effect compared to best not worse than epsilon at stage 1 (difference) 


©2013 Aptiv Solutions 


48 


























Power 


Power plot 


Power vs. Effect subset 2 

Prevalences = (10 90) 

IH 



0 H- 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 -r 

0 0.05 0.1 0.15 0.2 0.25 0.3 0.35 0.4 0.45 0.5 

Effect subset 2 


Selection rule 

17 - - Select set with largest effect at stage 1 (difference) 

17 - - Select the 2 sets with largest effect at stage 1 (difference) 

p' - Select sets with effect compared to best not worse than epsilon at stage 1 (difference) 
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Power 


Power plot 


Power vs. Effect subset 2 

Prevalences = (5 95) 



Selection rule 

R - - Select set with largest effect at stage 1 (difference) 

17 - - Select the 2 sets with largest effect at stage 1 (difference) 

p' - Select sets with effect compared to best not worse than epsilon at stage 1 (difference) 
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Results 


• Clear power disadvantage for procedure that 
never selects a sub-population 

• No clear advantage of selecting always (and only) 
the best population 

• For small prevalences, always selecting the best 
can even provide a small loss in power 
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Summary 


• Attractive and general procedure for adaptive confirmatory 
design that controls Type I error rate 

• The “rules” for adaptation and stopping for futility 

■ Do not need to be pre-specified 

■ Adaptations may depend on all interim data including secondary 
and safety endpoints. 

■ Can make use of Bayesian principles integrating all information 
available, also external to the study 

■ Should be evaluated (e.g. via simulations) and preferred version 
recommended, e.g., in the Simulation Report or DMC Charter 

• Comparison of different strategies and options for analyses is 
mandatory. The role of simulation becomes Increasingly 
Important 
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QUESTIONS ??? 
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